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Abstract 

We study analytically M-spin-flip stable states in disordered short-ranged Ising 
models (spin glasses and ferromagnets) in all dimensions and for all M. Our approach 
is primarily dynamical and is based on the convergence of a*, a zero-temperature 
dynamical process with flips of lattice animals up to size M and starting from a deep 
quench, to a metastable limit o"°°. The results (rigorous and nonrigorous, in infinite 
and finite volumes) concern many aspects of metastable states: their numbers, basins 
of attraction, energy densities, overlaps, remanent magnetizations and relations to 
thermodynamic states. For example, we show that their overlap distribution is a delta- 
function at zero. We also define a dynamics for M = oo, which provides a potential 
tool for investigating ground state structure. 

1 Introduction 
1.1 Overview 

Studies of spin glass dynamics often start from the assumption that their anomalous, and 
still poorly understood, features arise from the presence of a large number of "metastable" 
(i.e., locally stable) states within the spin glass phase (many reviews are available; see, for 
example, Refs. ^ ^). Although there exists plentiful (though mostly indirect) evidence 
for the presence of many metastable states in spin glasses, little hard knowledge of their 
properties has been obtained. Most treatments of spin glass dynamics must therefore rely 
on assumptions — that often differ widely — about their number, nature, and structure |@, ||, 
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Questions regarding metastability (and the accompanying 

•ed systems, such 
Any information 



"broken ergodicity" ll^) are important also in the study of other disordered systems, such 
as glasses 
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p!9|] , and of certain neural network models 
on spin glass metastable states, obtained from first principles and without assumptions, 
would therefore be highly useful. (The reader who wishes to cut to the chase is referred to 
Subsecs. |1.2.1| , |1.2.2| below, where our results, providing such information, are summarized.) 

Numerical simulations have provided much of the evidence for the existence of metasta- 
bility in spin glasses; indeed, the presence of metastability has often been an impedi- 
ment to studies of equilibrium properties [^, and has in turn led to new numerical 
techniques such as simulated annealing p5|, EH]. Experiments are frequently interpreted 



through the use of metastable states and are used to try to extract information about 
them; early examples include ac susceptibility, time-dependent magnetization, spin echo, 
Mossbauer effect, and others 0]. More recent experiments that may provide information on 
metastable states include measurements of noise in mesoscopic spin glasses [^] and aging 
0, H, H, ^ H, |, [ly, |Tl], [12], [1^, |15|, |1^]. However, because assumptions about the number 
and structure of metastable states must invariably be made, our general understanding of 
the role played by metastability in spin glass dynamics remains relatively primitive. 

Because this understanding cannot be obtained through conventional statistical mechan- 
ical tools, few analytical results are available, and are usually confined to the case of 1-spin- 
flip (energetically) stable states. In early work, Tanaka and Edwards [^, Bray and Moore 
p9| , and De Dominicis et al. |]30[ studied their number in the Sherrington-Kirkpatrick 
(SK) (or equivalently, the Thouless- Anderson-Palmer (TAP) |^) mean field spin glass. 
They found that the number of 1-spin-flip stable states in a system of N spins scaled as 
exp(0.1992A^). Nemoto studied the same set of metastable states, and asserted both 
that their energy levels behaved as in a random energy model, and that the barrier energy 
between them is an increasing function of their Hamming distance. Vertechi and Virasoro 
||3^ , in both analytical and numerical work, and confining their analysis to the lowest energy 
(metastable) states, found results consistent with the hypothesis that the energy barriers 
between metastable states scale with their Hamming distance; they suggested that this cor- 
respondence might explain the mean field ultrametric organization of states. Other work has 

as well as on metastable 
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also been done on the distribution of barriers in the SK model 
states in other mean-field models, including the infinite-ranged p-spin-interaction spin glass 
36| , the spherical p-spin model the infinite-ranged Potts glass [Q, and related systems 



such as Kauffman's N — k model 



There exist few theoretical results on metastable states in short-ranged disordered systems 
in two or more dimensions even though results on these would be important in interpreting 
laboratory experiments. Rare analytical results have been obtained on a one-dimensional 
spin chain with a continuous coupling distribution symmetric about zero [1^, ^ . It was 



found that the number of 1-spin-flip stable states increases exponentially with the system 
size (in [40], metastable states of greater than single spin stability were also examined). 
Derrida and Gardner further showed that there existed a maximum magnetization above 
which there existed no metastable states. Bray and Moore ]H3[ have presented a replica 
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formalism for studying 1-spin-flip stable states in finite dimensional spin glasses; using this 
formalism, they carried out a stability analysis about mean field theory and studied some 
of the properties of metastable states with higher energies. More recently, numerical studies 



44 1 of the two-dimensional ±J spin glass seem to indicate that as system size increases, the 



energy densities of the (1-spin-flip) metastable states converge to a single value. 

Summarizing, it appears that until now it has been difficult to obtain hard analytical 
results on metastable states in short-ranged spin glasses in dimension greater than one. Aside 
from demonstrating that such states almost certainly exist in spin glasses and are important 
in determining their physics, neither experiment nor numerical work to date can provide 
unambiguous and detailed information on their structure. Both analytical and numerical 
analyses that directly address the properties of metastable states (as opposed to inferring 
their properties indirectly) have mostly been confined either to mean-field or one- dimensional 
models, and are usually limited to the study of 1-spin-fiip energetically stable states. 

In this paper we provide rigorous results on metastable states that rely on no approxima- 
tions or assumptions. We will analyze the properties of metastable states in disordered spin 
systems (in particular, spin glasses and random ferromagnets, both with continuous coupling 
distributions) in all finite dimensions, and we will study states that are energetically stable 
p5| up to a fiip of any M spins, where M < oo can be arbitrarily large. Both infinite volume 
and finite volume systems will be addressed. 

Before proceeding, we wish to add one cautionary note. Although we believe that the 
concept of metastable states is both interesting and useful in understanding spin glass (and 
other) dynamics, we believe also that alternative (but not necessarily orthogonal) formula- 
tions exist that have the potential to provide this understanding without direct invocation 
of such states. These are fully real-space pictures, such as droplet-scaling [^, ^ but 
possibly also others, that interpret nonequilibrium spin glass dynamics following a quench 
through the resulting domain structure [|^, 0]. Such approaches have several advantages, 
in our opinion, over those invoking metastable states (especially over those that make no 
contact with real-space structure). First, they require fewer assumptions (most of which, 
however, remain neither verified nor disproved) and those assumptions are typically more 
accessible to numerical or analytical tests than those regarding metastable states. Second, 
the idea that the sample breaks up into domains, of whatever ultimate nature, following a 
deep quench is appealing and likely correct. 

While the distinction between the thermodynamic pure states and metastable states of 
a system remains important, the overwhelming focus on metastable states (divorced from 
real-space considerations) has led in part to the common viewpoint that pure state structure 
is irrelevant to dynamics, because the system is believed to spend all its time in a single 
pure state. We have shown elsewhere |51| that this is in general not correct, particularly for 
nonequilibrium dynamics following a deep quench. The pure states are indeed relevant to 
dynamics, and at some level metastability and metastable states (at both zero and positive 
temperature) should be related to a description based upon the pure state structure. We 
will not discuss such a relation further in this paper, and will treat metastable states inde- 
pendently from these considerations. If the above caveat is kept in mind, then the study 
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of metastable states can provide a useful (but not orthogonal) complement to real-space 
approaches based on thermodynamic pure state structure. 



1.2 Summary of results. 

Although most of our results will apply to many types of disordered systems, we consider 
for specificity the Ising spin Hamiltonian on the d- dimensional infinite cubic lattice Z'^, 



Here the sites x are in Z"^, the spins = ±1, and the sum is over nearest neighbors. The cou- 
plings Jxy will be taken to be independent, identically distributed random variables (though 
occasionally we will examine other cases); we require of their common distribution that it 
be continuous and have finite mean (and, for some of our results, further requirements). We 
denote hj J' a particular realization of all the couplings. 

Both the spin glass and ferromagnetic cases will be considered. In the first case, the 
couplings can take on either positive or negative values, typically (but not necessarily) sym- 
metrically distributed about zero; this is the Edwards- Anderson (EA) Ising spin glass model 
15^ . In the second case, the couplings take on only positive values. A Gaussian distribution 
of couplings with zero mean is most commonly used in the spin glass case, while a uniform 
distribution of couplings in the interval [0, J] typifies the random ferromagnet. While our 
results are not restricted to these distributions, we will use them often throughout the paper 
for clarity. 

A 1-spin-fiip stable state is defined as an infinite- volume spin configuration whose energy 
as given by Eq. (|1|) cannot be lowered by the flip of any single spin. Similarly, an M-spin- 
flip stable state (M < oo) is an infinite-volume spin configuration whose energy cannot be 
lowered by the flip of any subset of 1, 2, . . . , M spins. Finally, a ground state is an infinite- 
volume spin configuration whose energy cannot be lowered by the flip of any finite subset of 
spins. 

All of the above definitions can be extended in a natural way to finite- volume metastable 
states with specified boundary condition. For finite-volume ground states, however, we can 
use the alternative (and more natural) definition that it is the spin configuration (or spin 
configuration pair, in the case of spin-flip-symmetric boundary conditions, such as free or 
periodic) that has the lowest energy given the specifled boundary condition. It is easily 
seen both that the deflnition given in the preceding paragraph is equivalent to this in flnite 
volumes, and that the second deflnition has no natural extension to inflnite volumes. 

It has occasionally been noted that a deflnition of the energy (or free energy) barrier 
conflning a metastable state remains ambiguous at least until a speciflc dynamics is deflned. 
We note here that this problem does not exist for the deflnition of (energetically) metastable 
states themselves, which can be deflned solely through the use of a Hamiltonian such as 
Eq. (|1|). Nevertheless, the essential approach of this paper will be to study the metastable 
states by using dynamics to obtain a natural ensemble of these states. 
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1.2.1 Questions. 

Given these definitions, we can now ask for information about the metastable states of 
disordered systems such as spin glasses. We will not attempt to be precise here, and some 
concepts (e.g., basin of attraction) remain to be defined. This and the following subsection 
are intended only to serve as an overview of our main results, and as a reference point when 
reading later sections of the paper. 

The most basic questions about metastability include: 

1) At the most basic level, can the existence of metastable states be proved? If yes, how 
many 1-spin-flip, 2-spin-flip. . . . metastable states exist in d dimensions? Does the number 
of M-spin-flip stable states vary with M or dl If this number is infinite for some M and/or 
d, is it a countable or uncountable infinity? 

2) Given an initial spin configuration (following a deep quench) and a specified zero- 
temperature dynamics (such as ordinary Glauber dynamics), does o"*, at time t, evolve 
towards a single final metastable state (i.e., do the dynamics converge)? If so, how 
much of the initial information contained in the starting spin configuration is contained in 
the final state, and how much varies with the particular realization of the dynamics (nature 
vs. nurture)? 

3) How large are the basins of attraction of the metastable states? 

4) What is the distribution of energy densities of the metastable states? 

5) What is the metastable state structure in configuration space? For example, does there 
exist any nontrivial overlap distribution, in finite or infinite volume? Is there any scaling of 
the barrier height (defined in some suitable or reasonable way) between l-(or higher)-spin-fiip 
stable states with their Hamming distance, as has sometimes been claimed? 

6) Does the number and structure of the various types of metastable states differ for those 
that arise dynamically from two independent starting configurations, as opposed to those that 
evolve from the same initial configuration? (This is somewhat different from the questions 
asked in 2), though not orthogonal.) 

7) What does 1) imply about how the number of metastable states scales with volume in 
finite samples? Do the answers to 2)-6) change for (large) finite volumes? 

8) What is the remanent magnetization in (i-dimensional spin glasses when the initial spin 
configuration is uniformly +1? 

9) Is there any correspondence between pure and metastable states? More precisely, is the 
spin configuration corresponding to a typical metastable state in the domain of attraction of 
a single pure state (at positive temperature, assuming multiple pure states) or ground state 
(at zero temperature)? 

10) Do the answers to these questions about metastable states provide any interesting ther- 
modynamic information, such as the structure of ground states at zero temperature or pure 
states at positive temperature? 
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1.2.2 Main results. 



In this subsection we present tlie "short" answers to the above questions, without discussion 
or elaboration. A fuller discussion, without which these answers should be regarded as 
sketchy and incomplete, will be provided in later sections. 

The numbers refer to the corresponding questions from the previous subsection. The 
section of the paper in which the claim made below is proved and/or discussed is also given. 

1) In an infinite system, the Hamiltonian Eq. (|l]) displays uncountahly many M-spin-fiip 
stable states, for all finite M > 1 and for all finite d>l (Sec. 

2) For almost every JT", a*^ and dynamics realization uj (to be defined in Sec. ^ [Q, a final 
state 0"°°, depending on the particular dynamics, exists. Put another way, every spin flips 
only finitely many times (Sec. ^ . (This result is not obvious and indeed is not the case 
for other systems, such as homogeneous ferromagnets on Z'^ — at least for low d\ see, e.g.. 



5T| , pq).) In the usual 1-spin-fiip Glauber dynamics in ID, precisely half the spins in 
are completely determined by a'', with the other half completely undetermined by cr°. 
For higher d and the same dynamics, it can be shown that a dynamical order parameter qo-, 
measuring the percentage dependence of cr°° on cr°, is strictly between and 1 (Sec. |6.1|) . 
(All results hold for almost every J", a", and u.) 

3) The basins of attraction of the individual metastable states are of negligible size. That 
is, almost every initial configuration ct° is on a boundary between (two or more) metastable 
states (Sec. |^). Equivalently, the union of the domains of attraction of all of the metastable 
states forms a set of measure zero (in the space of all a^'s). (A similar result for pure states 
was proved in ||5T[| .) 

4) For any fc, almost every fc-spin-fiip stable state has the same energy density, E^. Moreover, 
the dynamics can be chosen so that Ei > E2 > > . . . , and furthermore Ek for any finite 
k is larger than the ground state energy density, which of course is the limit oi Ek as k ^ 00 
(Sec. I). 

5) Almost every pair of metastable states (either two /c-spin-fiip stable states or one k- and 
one fc'-spin-fiip stable state) has zero spin overlap. This conclusion does not change when 
one restricts attention to any (positive measure) subset of metastable states (Sec. H). 

6) For two metastable states arising from two independently chosen starting configurations 
(j° and cr'°, the answers given above hold. For almost any pair of metastable states arising 
from the same a^, the answers in 1), 3), and 4) still hold, but the answer to 5) is modified: 
it remains true that almost every pair has the same overlap, but the overlap is now positive, 
and equal to the quantity go (Sec. H). 

7) The number of metastable states in finite samples scales (for sufficiently large volumes) 
exponentially with the volume in general d for states of any stability. It is already known 
that the number of 1-spin-flip stable states in a one-dimensional chain of length L increases 
as 2^^^ ^ . Exact results can be obtained in higher dimensions for some other models. In 



(large) finite volumes, the answers to 2) and 4)-6) still hold (but there will be some smearing 
of the delta-functions due to finite- volume effects). For 3), the size of the basins of attraction 
of the metastable states falls to zero as volume increases (Sec. |]). 
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8) The remanent magnetization in one dimension is known to be 1/3 |56|. In higher dimen- 
sions, a heuristic calculation suggests a lower bound on the remanent magnetization that for 
large d behaves like e"^'^^"^^'^-' (for a Gaussian spin glass). Exact results can be obtained in 
all d for some other models, to be discussed in Sec. |. 

9) At zero temperature, almost no metastable state should be "contained" within a single 
ground state. If more than one pure state exists at some positive temperature, then almost 
no metastable state should be contained within a single pure state. That is, almost every 
metastable state should be on a "boundary" in configuration space between multiple pure 
or ground states (Sec. |^. 

10) Information on metastable states so far does not seem to provide information on infinite- 
volume pure or ground states. That is, we will see that one can have a situation (the 2D 
disordered ferromagnet) where there exists an uncountable number of (infinite-volume) M- 
spin-fiip stable states for M arbitrarily large, but in which there exists only a single pair of 
pure states at low temperature (Sec. [1^). In situations of this kind, the presence of many 
metastable states could conceivably lead to difficulties in interpreting numerical studies of 
equilibrium properties, such as the number of pure (or ground) states. 

The claims made in 1) - 6) will be proven rigorously. For 7), the claim of exponential 
scaling of the number of states will be proven rigorously; the claim concerning overlaps 
in finite volumes will be proven rigorously when M = 1 for a class of disordered systems 
thermodynamically equivalent to ordinary spin glasses and random ferromagnets. This result 
should hold also for M > 1 and for ordinary spin glasses and random ferromagnets; for these, 
heuristic arguments will be presented. The claims of 8) include rigorous exact results for 
certain models and heuristic lower bounds for other disordered systems. The claims of 9) 
are motivated by 3), but have not yet been formulated in a rigorous way. The claim of 10) 
is based on a conjecture that is widely believed but that remains to be proven rigorously. 

1.2.3 Outline of rest of paper. 

In Sec. ^ we present the dynamical processes to be considered. The single-spin dynamics 
is simply the zero-temperature limit of the usual Glauber dynamics, but we present also a 
multi-spin-fiip dynamics. Sec. ^ presents arguments showing convergence of the dynamics 
to final states in several contexts: both finite- and infinite-volume ordinary spin glasses 
and random ferromagnets (hereafter referred to simply as ordinary disordered models) in 
any dimension, for strongly and highly disordered models, and finally for certain types of 
homogeneous systems. In Sec. ^ we prove that the number of M-spin-fiip stable states 
is uncountably infinite for ordinary disordered models, in any dimension and for any M, 
and that the spin overlap distribution is a delta-function at zero. We also discuss there 
implications for arguments that barriers between metastable states scale with their Hamming 
distance. In Sec. ^ we show that the energy densities of all M-spin-fiip stable states (except 
for a set of measure zero) are the same, and show that a natural choice of dynamics leads 
to lower energy densities for states of higher stability. We also present there a cautionary 
discussion about how to interpret and use these and related conclusions. 
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We then present, in Sec. a calculation of the "remanent overlap" (and for spin glasses, 
remanent magnetization, which is a special case) for highly disordered models, and also 
provide a (nonrigorous) lower bound of this quantity for ordinary disordered models in 
general dimensions. In the same section we also compute the dynamical order parameter 
qn for ordinary disordered models in one dimension and highly disordered models in general 
dimensions. In Sec. ^ we show that the basins of attraction of almost every metastable state 
have measure zero, and remark that no metastable states (as always, aside from a set of 
measure zero) should themselves lie completely in the basin of attraction of any ground (or 
at positive temperature, pure) state. In Sec. | we show that the spin overlap distribution for 
two metastable states dynamically evolved from the same (random) starting configuration 
is g£), almost surely. In Sec. |^ we re-examine many of the above results for finite- volume 
disordered systems, and show that their qualitative features persist in large finite volumes, 
and that quantitative agreement with the infinite-volume results is increasingly better as the 
volume increases. In Sec. ITDI, we present a dynamics that generates infinite-volume ground 



states, and discuss their relation with metastable states. Finally, in Sec. |TT|, we present our 
conclusions. 



2 Dynamics 

Theoretical studies of metastable states usually look directly for 1-spin-flip stable config- 
urations for the Hamiltonian (as in, e.g., pO| , p] , |4^ ) or for 1-spin-flip stable solutions of 
self-consistent equations for the magnetization (as in, e.g., [|^). Here we propose instead a 
dynamical approach, in which the time evolution of the system is exploited as a theoretical 
tool in determining the answers to the questions posed in Sec. |1.2| . We start by describing 
the dynamics that will be used. 

We begin by considering the standard zero-temperature Glauber single-spin-fiip dynam- 
ics. In every dynamical process considered in this paper, the coupling realization J is taken 
to be fixed. We denote by cr° the initial (time zero) infinite-volume spin configuration on 
Z'^. The starting state cr° is chosen from the (infinite-temperature) ensemble in which each 
spin is equally likely to be -|-1 or —1, independently of the others. The spin configuration 
is updated asynchronously, in that a single spin at a time is chosen at random, and then 
always flips if the resulting configuration has lower energy and never flips if the resulting 
configuration has higher energy. (Because the coupling distribution is continuous, there is 
no possibility of a flip costing zero energy. In models where zero-energy flips can occur, as 
in uniform ferromagnets |^T], 0, ^ or ±J spin glasses [0, the standard rule is that the 
chosen spin then flips with probability 1/2.) 

The notion of choosing a spin "at random" needs clarification for an infinite-volume 
system. More precisely, the (continuous time) dynamics is given by independent (rate 1) 
Poisson processes at each x corresponding to those times t at which the spin at x looks at 
its neighbors and determines whether to flip. We denote by ui a given realization of this 
zero-temperature single-spin flip dynamics; so a given realization uji would then consist of a 
collection of random times t^^i {x G Z'^, i = 1, 2, . . .) at every x when spin flips for the spin 
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ax are considered. 

Given the Hamiltonian (|l|) and a specific J ^ o"", and c<Ji, a system will evolve towards a 
single well-defined spin configuration a* at time t. It is important to note that these three 
realizations (coupling, initial spin, and dynamics) are chosen independently of one another. 
The continuous coupling distribution and zero-temperature dynamics together guarantee 
that the energy per spin E{t) is always a monotonically decreasing function of time. 

The above dynamics is commonly used in a variety of problems. We now introduce a 
dynamics that employs multiple-spin flips. Consider a dynamics in which rigid flips of all 
lattice animals (i.e., finite connected subsets of Z'^, not necessarily containing the origin) up 
to size M spins can occur. One could restrict flips to only simply connected lattice animals 
(i.e., no holes), but we will not do so. The case M = 1 is the single-spin flip case just 
described; M = 2 corresponds to the case where both single-spin flips and rigid flips of all 
nearest-neighbor pairs of spins are allowed; and the case of general M corresponds to flips of 
1-spin, 2-spin, 3-spin, . . . M-spin connected clusters. A specific realization of this M-spin-flip 
dynamics will be denoted ujm- 

The probability measure Pm from which a dynamical realization ujm is taken must be 
chosen so that the resulting dynamics is sensible, i.e., so that the dynamics leads to a 
single, well-defined a* for almost every JT", cr°, and ujm- Furthermore, we wish the dynamics 
to remain sensible even in the limit M — oo. An initial requirement on Pm is that the 
probability that any fixed spin considers a flip in a unit time interval remains of order one, 
uniformly in M. Such a choice would guarantee, for example, that the probability in Pm 
that a spin considers a flip in a time interval At vanishes as At 0, uniformly in M. A 
further requirement for the dynamics to be well-defined is that information not propagate 
arbitrarily fast throughout the lattice as M becomes arbitrarily large. 

We therefore construct our dynamics as follows: Pm for M fixed assigns all simply 
connected lattice animals of size k (i.e., containing k spins) a dynamics chosen from a 
Poisson process as in the single-spin-flip case, but with rate Rk > depending on k, for 
k = 1,2, .. . , M. We take, as before, Ri = 1, and in general will require that -R^+i < Rk 
for all k. As always, the dynamical process governing the flipping of any lattice animal is 
independent of that for all others. 

It is not hard to show that for any spin to flip at a rate of order one, independent of 
M in the multi-spin-flip dynamics, it is enough to require that hkRk < oo, where 

hk is the number of lattice animals of size k that contain the origin. This number scales 
exponentially in k, with the constant in the exponential (generally not known for most d) 



dependent on the lattice type and dimensionality |58|. We therefore define our dynamics 



so that Rk ~ exp[—a{d)k], where a{d) > depends only on dimension. In order that 
information not propagate infinitely fast even after M ^ oo, we choose a{d) large enough so 
that hkRk still decays exponentially fast as k —>■ oo (see also Theorem 3.9 in Chap. I of ||59|| ) . 
There might exist slower falloffs of Rk with k that would also give a reasonable dynamics, 
but our purpose here is only to point out that such dynamics do exist. 

We emphasize that we are not proposing this multi-spin-flip dynamics in order to model 
dynamical processes in actual spin glasses (although it could conceivably be useful for that 
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purpose). Its intended use is rather as a theoretical tool to help elucidate the structure of 
metastable states. We now proceed to show how this may be done. 

3 Convergence of the Dynamics 

In this section, we study the question of convergence of a* to a final (metastable) state 
a°° . As always, we consider a disordered Ising spin system with energy given by Eq. (|l|), 
whose coupling realization J is fixed throughout the dynamical process. Unless otherwise 
specified, J will be chosen from a continuous coupling distribution with finite mean (but 
other distributions will also be briefly discussed). The initial spin configuration a" is chosen 
from the (infinite-temperature) distribution described at the beginning of Sect. 0. Strictly 
speaking, the dynamical process corresponds to that following an instantaneous quench from 
infinite to zero temperature. Physically, such a process is often used to model the behavior 
of systems following a deep quench from high to low temperature. 

We will consider the system's evolution to a final state in both the finite-volume and 
infinite-volume cases. The question of convergence is not so obvious in the infinite-volume 
case, but is rather easy in the finite-volume case, so we will begin there. 

3.1 Finite volumes 

We will denote by A^, C Z'^ the cube centered at the origin and by the number of 
sites in A^,. Given some specified boundary condition (periodic, fixed, free, etc.) on dKi, the 
boundary of A^, there is a unique (with respect to spin configurations, modulo a global spin 
flip if the boundary condition is spin-symmetric) minimum over all spin configurations 
of the energy within A^,. The uniqueness, for almost every J , is a consequence of the couphng 
distribution being continuous. Similarly, for almost every J there will be a minimum energy 
change Aj^j^ > over all possible flips (of lattice animals strictly contained in A^ up to size 
M < |Ai|) in all of the 21^^' spin configurations in A^,. The actual value of will depend 
on J , the boundary condition, and the choice of dynamics, i.e., the value of M in Pm- The 
energy E^^\Q) at time is finite, so the total number of spin flips is bounded from above by 
(E(^)(0) -Ei,^i)/Aj^i. It follows that the spin configuration converges, after a finite number 
of spin flips in finite time, to some limiting a'^^^^ (depending on cr^^-) and ujm)- We now turn 
to the more interesting case of dynamical convergence to a limiting spin configuration in 
infinite volumes. 



3.2 Infinite volumes 



3.2.1 "Ordinary" spin glasses and random ferromagnets 

Given the Hamiltonian (|l]) and a continuous coupling distribution with finite mean, it was 
proved in ||5^ for M = 1 that every spin flips only finitely many times for almost every J', 
(To, and Ui. This was implied by a more general result that even if the coupling distribution 
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is not continuous, (in almost every realization) there can be only finitely many energy- 
decreasing flips (as opposed to zero-energy flips) of any spin. Given both the dynamics and 
the continuity of the coupling distribution, every spin flip strictly decreases the energy, and 
the implication follows. We now sketch the proof given in |^5|, modifled very slightly to 



incorporate the more general M-spin-flip dynamics; we refer the reader to |Q for technical 
details. 

We denote by a* the value of the spin at x for flxed J , cr°, and ojm- Deflne 



E{t) = -{1/2) J^y^i^l (2) 

y:\\x-y\\=l 

where the overbar indicates an average over {J, a^,uj]\j) and ||x — ?/|| denotes Euclidean 
distance. By translation-ergodicity of the distributions from which J', a^, and ujm are 
chosen, and using the assumption that the distribution of JT" has flnite mean, it follows that 
E{t) exists, is independent of x, and equals the energy density (i.e., the spatial-average 
energy per site) at time t in almost every realization of J^, a^, and u. 

Clearly E{0) = (because of the spin-flip symmetry of the distribution of cr°) and 
E{oo) > —d\Jxy\- We now choose any flxed number e > 0, and let be the number of 
flips (over all time) of the spin at x (i.e., of lattice animals containing x) that lower the total 
energy by an amount e or greater. Because —d\Jxy\ < E{oo) < —{e/M)N^, it follows (for 
almost every J', o"°, and um) that for every x and every e > 0, is flnite. Then if is the 
minimum possible magnitude of the energy change resulting from a flip of a lattice animal 
containing x, we need only show that e^; > for every x. The value of of course varies with 
X and will depend on both J' and the value of M in the dynamics measure Pm- Let ^{k,x) 
be the magnitude of the minimum energy change, in all spin conflgurations, over flips of all 
lattice animals of size k containing x; clearly A(^k,x) > 0. Then ex = mini<fc<M A(^k,x) > 
because M < cxd. 

We have therefore proved for any M < oo the existence of a limiting state 0"°° for almost 
every J', o"°, and ujm- The flnal state o"°° of course depends on all three realizations, and 
will be an M-spin-flip stable state. Before exploring the consequences of this result, we turn 
briefly to a discussion of some other systems. 

3.2.2 Strongly and highly disordered models 

There is a class of "strongly disordered" coupling distributions, where the mechanism for 
convergence of smg'/e-spin-flip dynamics is more localized |^5| than the one given just above. 



This class includes distributions with inflnite mean as well as ones with flnite mean (although 
we retain the requirement that the coupling distribution be continuous). These are coupling 
distributions such that "influence percolation" pU| does not occur on Z'^; we note that 



this requirement yields a d-dependent class of distributions. The reason for convergence 
of dynamics is different in these cases, and a new approach based on the idea of influence 
percolation is needed. To discuss this we flrst describe the notion of influence. 

We say that the spin at y can influence the spin at x (where — = 1) if changing ay 
can alter whether the energy change resulting from a flip of x is less than (or equal to, or 
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greater than) zero in some spin configuration. So, for example, if the couphng J^y = than 
y cannot influence x and vice-versa. (This possibility, and also that of zero energy changes, 
is excluded here, however, because we assume that the coupling distribution is continuous.) 



If Jxy 7^ 0, then the (necessary and sufficient) condition that y can influence x is [|60 | 



l^xyl ^ I (^z'^xzl (3) 

z:\\x—z\\=l,z^y 

for some choice of the cx^'s (in { — 1,+!}). Because the condition (|^) cares only about the 
coupling magnitudes and not the signs, the discussion applies equally well to spin glasses 
and random ferromagnets. 

We now consider the graph consisting of all sites in Z'^ but only those bonds {x, y} such 
that either x can influence y or y can influence x or both. The properties of this graph 
(called the influence graph in |Q) that are valid for almost all J7, will depend on both d and 
the coupling distribution. If there is no percolation of the influence graph (i.e., if given some 
J', all the clusters of the influence graph are finite) and there is no possibility of zero energy 
flips, then every spin can flip at most finitely many times (for every cr° and for almost 
every Ui). This is because the dynamics is effectively localized: the dynamics on Z*^ of the 
infinite-volume spin configuration breaks up into dynamics on disconnected finite regions. 
The result then follows (as in the analysis above of finite- volume dynamics). If influence 
percolation does occur, then no conclusions can be drawn (without further information) on 
whether spins can flip infinitely often. We note that for d = 1, any continuous coupling 
distribution will result in influence nonpercolation. 

An example of a system where influence nonpercolation occurs (and so the dynamics 
converges) is the "highly disordered" model of [0, ^ Here the couplings are volume- 
dependent and "stretched out" so that in large finite volumes, the magnitude of any coupling 
is at least twice that of the next smaller one and no more than half that of the next larger one. 
However, influence nonpercolation can also occur in less extreme situations, in particular the 
class of models we call "strongly disordered" . Roughly speaking, these are models in which 
the above condition on the stretching of the couplings typically holds up to some maximum 
size volume (which still needs to be sufficiently large), but not for arbitrarily large volumes. 
For a more detailed description, see . 



3.2.3 Other systems 

It is not difficult to see that the proof outlined in Subsec. |3.2.1| allows for a restatement of the 
dynamics convergence theorem as follows: given M-spin-flip zero-temperature dynamics in 
an infinite spin system where the energy per site is bounded, and the initial spin configuration 
is chosen from a spatially ergodic measure, there can (with probability one) be only finitely 
many flips that cause a nonzero energy change. We can therefore apply this result not only 
to disordered systems with noncontinuous coupling distributions, but also to homogeneous 
systems such as uniform ferromagnets or antiferromagnets. Here the theorem implies that 
the question of convergence is lattice-dependent. For example, every spin flip will be energy- 
lowering in a uniform ferromagnet on a hexagonal (honeycomb) lattice in two dimensions, so 
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here too the dynamics will almost always converge from a random initial spin configuration 



54 



What about uniform ferromagnets on square lattices? Here we have proved ||5T], ^ that 
the opposite is true: for almost every a" and ivi (the result easily extends to multi-spin-flip 
dynamics, but we will not do so here), there is no convergence of the dynamics because every 
spin flips infinitely many times. It must remain true that every spin undergoes only flnitely 
many energy-lowering flips, so therefore every spin must undergo inflnitely many zero-energy 
flips. A more global viewpoint [51] is that there exists no flnite time after which the spins 
within some flxed, flnite region remain in a single phase; that is, domain walls forever sweep 
across the region. We do not yet know what happens in uniform ferromagnets on Z"^ in 
dimensions higher than two, although numerical simulations 0] indicate the possibility of 
dynamical convergence in flve and higher dimensions. 

Finally, we briefly discuss the ±J spin glass (and related models). In two dimensions, 
we can show that this is an intermediate case: (for almost every and Ui) a positive 
fraction of spins flip inflnitely many times and a positive fraction flip only flnitely many times. 
Similar behavior occurs in spin glasses or random ferromagnets with other noncontinuous 
distributions (e.g., the couplings can take on only two or a flnite number of values, and the 
distribution need not be symmetric about zero). In all of these, a limiting state a°° does not 



exist [35|. For noncontinuous distributions other than ±J models, these conclusions remain 



valid for all c? > 2 (whether that is so for ±J models is unclear). 

A discussion of these systems was included only for comparison purposes; our primary 
interest in this paper will be in ordinary spin glasses and random ferromagnets with con- 
tinuous coupling distributions. We now examine the consequences of the results from this 
section. 



4 Numbers and Overlaps of Metastable States 

In Sec. ^ we established that our M-spin-flip dynamics converges to a flnal state for 
almost every J', cr°, and ujm- We will hereafter denote by cr^ the flnal state reached in this 
way. By the deflnition of the measure Pm from which the dynamical realizations um are 
chosen, it immediately follows that is an M-spin-flip stable state (for J'), which is a 
function also of ct° and ujm- 

It will be convenient to use a shorthand notation where (for flxed J') cr^ denotes 
a'^^a^ ,um) and a'^, denotes (T^/((t'°, tu^,^/), where a'" and u'j^p are chosen independently 
of cr° and um- When M' = M, and a'^ represent a pair of replicas. We deflne the 
overlap Qm,m' of o"^ and a'^, in the usual way: 



Qm,m' = QiJ,a',u;M,cr",u'^,) = lim \Al\-' E ^m,.^m',x, (4) 

where cr^ ^ is the value of the spin ax in the metastable state cr^ and a'^i ^ is the value of 
ax in a'^i. When M' = M, Qm,m is the overlap of the replicas cr^ and a'ff. 
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We now show, in the following theorem, that for any finite M there is an uncountable 
infinity of cr^'s [^, and that almost every pair cr^, a'^ (as ,ujm,o''^ ^^^iry indepen- 
dently) has overlap zero. 

Theorem 1. In a disordered spin system with Hamiltonian (|I|), for almost every fixed 
J chosen from a continuous coupling distribution with finite mean, there is an uncountable 
infinity of M-spin-flip-stable states for any M [^. Furthermore, for any M and M', almost 
every pair has overlap zero; i.e., (for almost every J) the infinite- volume overlap distribution 
of Qm,m' is a single delta function at zero. 

Proof. We first show that almost every pair of metastable states, (c^,o"^), has zero 
overlap, and then, by taking M' = M, show how this implies an uncountable infinity of 
metastable states. For a fixed (finite) M and almost every J', we showed in Sec. § that for 
almost every a" and um the dynamics converge to a limiting metastable state af}{cr'^ ,ljm)- 
Consider two such final states cx^ and a'^,, as defined above. Clearly their overlap Qm,m' 
is a measurable, translation-invariant function of its five arguments. Moreover, because 
each of the five distributions from which J, ,ujmiO''^ lOj'j^, are chosen has the property 



of translation-ergodicity (see ^\ for a discussion of this property and its use), it follows 
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that the same property holds for the joint (product) distribution of (j7, 0"°, cjm, cr 
The translation-invariance of the random variable Q (which is immediate from the right- 
hand side of (^)) then implies that it must be constant for almost every realization of 
(JT", cr°, o^M, o;^/). Let us suppose that this constant value, g, is nonzero. By the spin- 
inversion symmetry of the Hamiltonian (|1]), we must have 

q = Q{J, cr°, ujm, 0-'°, uj'^p) = -Q{J, cr°, ujm, -cr'°, uj'm>) = -q (5) 

for almost every realization. In the last step we used the fact that — cr'° can be replaced by cr'° 
because Q is constant almost surely (and the distribution of a'^ is spin-inversion symmetric). 
It follows from Eq. (^ that q = 0. 

Now take M' = M and suppose that there were a countable number (including the 
possibility of a countable infinity) of M-spin-flip-stable states. This would imply that, with 
positive probability, two independently chosen starting configurations and dynamics would 
result in the same final state, which would have a self-overlap of +1, so that Qm,m would 
have a delta function component at +1 with nonzero weight. It follows that, for any finite 
M, there must be an uncountable infinity of such states, o 

Remark. A crucial step in the proof is the existence of a limiting final state, i.e., almost 
sure convergence of the dynamics. It is the absence of this knowledge that prevents us 
from reaching similar conclusions about ground states (Sec. 0) or pure states at positive 



temperature fSl]] if broken spin- flip symmetry should exist. (We note also that in other 



respects, the method used in this proof is similar to that used in the proof of Theorem 2 



of 1^). It follows that the conclusion of Theorem 1 holds also in other models where the 
dynamics converge, such as the highly and strongly disordered models discussed in Sec. ^ 
(but in these models the conclusions can also be obtained by more concrete arguments based 
on the localization of the dynamics due to influence nonpercolation, as discussed above). 
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The conclusion of Theorem 1 (with M' = M) holds for a general pair of M-spin-flip stable 
states. In Sec. ||, we will discuss how this conclusion is modified for two metastable states 
dynamically evolved from a single initial spin configuration. We discuss now some of the 
consequences of Theorem 1, particularly for the proposal that Hamming distance between 
metastable states scales with their barrier height, and that this might lead to a possible 
ultrametric organization of metastable states in realistic spin glasses |15|, |16[- A possible 
relation of this kind has been conjectured ||3^, |3^ to lead to an ultrametric organization of 



pure states in state space [£8| in the SK model. 

An analysis of this conjecture is hampered by the lack of a clear understanding of how 
to define the energy barrier between two metastable states, in the natural context of single- 
spin-fiip Glauber dynamics at positive temperature. However, possible progress on these 
questions has been made in the mean-field case. Previous studies ||2^, |6^ have indicated 
there that a critical energy Ec exists above which the (1-spin-flip-stable) metastable states 
are uncorrelated and have zero overlap, and below which correlations between barriers and 
Hamming distances are expected to emerge. So it is reasonable to expect that one should 
confine one's attention to energetically low-lying metastable states EM (see also the discus- 
sion on proper weighting of the states in It is also clear from general considerations 
that, because the distance between two states is symmetric between them but their relative 
barriers are not, any analysis should be confined to states with roughly the same energy (or 
energy density, in the infinite volume case) |3^ . 

Because we will show in Sec. ^ that (for a given M and choice of dynamical process) 
almost every metastable state has the same energy per spin, the above issues are already in 
part addressed. But the more crucial point is that in any subset with nonzero measure of the 
set of all metastable states, the same conclusion will hold; namely, that almost every pair 
chosen from this subset will have zero overlap. We conclude that for realistic spin glasses, 
and supposing that barriers between states can be defined in some natural way, there should 
be no general scaling of barriers with Hamming distance. This is because almost every 
pair of metastable states will have zero overlap, and either almost every pair also has the 
same energy barrier or else there's a distribution of such barriers. In either case, there's 
no nontrivial scaling of barriers with Hamming distance between states. Furthermore, this 
conclusion remains the same when considering metastable states of different M and M'. 
It should be noted however that these arguments do not rule out the possibility of some 
kind of scaling between pairs of states of zero probability — but such pairs are of negligible 
significance for deep quench dynamics . 

It might be thought that this conclusion may not apply to finite volumes; however, we 
will argue in Sec. || that the overlap distribution approximates a delta-function at the origin 
for large finite volumes. 



5 Energies of Metastable States 

We now turn to a discussion of energies of the metastable states. Our first result is to 
show that our dynamical construction yields a probability measure on the M-spin-fiip stable 
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configurations such that almost every one has the same energy density (i.e., energy per site). 

Theorem 2. For any dynamical measure Pm (defined as in Sec. 0), almost every cr^ has 
the same energy density Em, which is also independent of the coupling realization J'. 

Proof. Because the energy density of any metastable configuration ct^(J7', cr°, cua/) is a 
measurable, translation-invariant function of J^, 0"°, and um, it immediately follows by the 
same argument used in Theorem 1 that the energy density of the M-spin-fiip stable states 
is the same for almost every J', cr°, and Um- o 

The result of Theorem 2 is consistent with the findings of the numerical investigation of 



44| of the two-dimensional ±J spin glass, where the data indicated convergence to a single 
value of the energy densities of the (1-spin-fiip) metastable states as system size increased. 
Although Theorem 2, as stated, is restricted to systems where the dynamics converge to a 



limiting a°°, which is not the case for the ±J spin glass in 2D |^^, the same arguments 
imply much more generally convergence to a single limiting energy density. 

Even though our dynamical construction yields a probability measure on the M-spin- 
fiip stable configurations such that almost every one has the same energy density, it is 
incorrect to conclude that there does not exist a spectrum of energy densities among all 
M-spin-fiip stable configurations. For any d and for most models there will be a nontrivial 
spectrum in the sense to be described below; this spectrum can even be calculated in special 
circumstances, such as for the 1-spin-fiip stable states in one dimension [JT|. (Similarly, 



although the magnetization per spin is zero for almost every metastable state, a spectrum 
of magnetizations in ID was computed in |^. We will return to this topic in Sec. |^.) 

To clarify this issue, consider 1-spin-fiip stable states in the continuously disordered spin 
glass or ferromagnet in ID. The infinite spin chain can be broken up into "infiuence clusters" , 
as described in ^ (see also Subsec. p.2.2|) ; these are the finite spin chains bounded to 



either side by couplings whose magnitudes satisfy the condition 

I < min{| J„_i,„|, I J„+ l,n+2 |}, (6) 

where the integer n denotes a site along the chain. Because there is no frustration, every 
coupling within every infiuence cluster is satisfied in every 1-spin-fiip stable state, and the 
couplings between the infiuence clusters — i.e., those satisfying Eq. (||) — can be arbitrarily 
satisfied or unsatisfied. So one can, for example, take any percentage p of these "weak" 
bonds to be satisfied and still have a 1-spin-fiip stable configuration, resulting in a spectrum 
of energy densities among the set of all 1-spin-fiip stable states as p is varied. 

This example illustrates the important point that one must be careful in specifying what 
measure is imposed on the metastable states before discussing the distributions of energies, 
magnetizations, and other physical quantities over those states. In the ID example under 
discussion, each 1-spin-fiip stable state for a given JT" is specified (modulo a global spin fiip) by 
an infinite sequence of coin tosses — one for each weak bond. Here an outcome of "heads" on 
a particular toss implies that the corresponding weak bond is satisfied, and "tails" implies 
that it is unsatisfied. The probability measure on the set of crf^(j7', ci;i, cr°)'s imposed by 
the dynamics and initial condition (for fixed J') corresponds to independent tosses of an 
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unbiased coin, which is a natural measure for the purposes of analyzing outcomes of deep 
quench experiments. However, one could arbitrarily impose other measures, for example, 
those corresponding to flips of a biased coin; specifically, where the probability p of an 
outcome of heads on each (independent) flip has p 7^ 1/2. For any such fixed p, there are 
also an uncountable number of 1-spin-fiip stable states (except when p = or p = 1), all 
(outside of a set of measure zero) with the same energy — but the energy depends on p. 

Although this is relatively straightforward for the single-spin-flip case (even in higher 
dimension), it becomes more complicated when analyzing M-spin-fiip stable states with 
M > 1, because now the energies Em can in principle depend on the relation between the 
rates Rj for j-spin-fiips (defined in Sec. ^ as j varies between 1 and M. To see this, consider 
the case M = 2, and two different choices of P2 corresponding to different ratios R2/Ri- 
Returning to the ID chain, consider the final states and cr^, gotten when the rates are 
chosen so that R2/R1 -C 1 and R2/R1 ^ 1, respectively. In the former case, the dynamics 
allows the system to find (approximately) a 1-spin-fiip stable state state first, in which the 
probability that any given weak bond is satisfied is close to 1/2; the energy associated with 
the weak bonds is then lowered further by rigidly flipping neighboring pairs of spins. In the 
second case pairs of spins are flipping rapidly compared to single spins; there is no reason to 
expect the energies of cr^ and cr^ to be the same. Indeed they can be shown to be generally 
different in ID (in the limits R2/R1 — > and 00) by a more detailed (but lengthy) analysis. 

In general, one might consider for arbitrary M a natural dynamics where, for each k < M, 
the system first converges to a fc-spin-flip stable state cr^ before rigid k + 1-clusters begin to 
flip. Roughly speaking, this corresponds to a limit where each of the ratios Rk+i/Rk — ^ 0. 
A motivation for such a choice is that the systems of interest are at low temperatures, and a 
natural scaling with temperature of the ratio Rk+i/Rk is as exp[—f{k)/T], for some positive 
f{k). The next theorem is motivated by such a dynamical choice. 

For the first part of the theorem, our proof requires more about the common distribution 
of the couplings Jxy beyond our general assumptions that the distribution is continuous with 
a finite mean: namely, that the possible values of \Jxy\ include at least three very different 
scales — i.e., Ji, J2, J3 with J1/J2 and J2/J3 larger than some dimension-dependent constant. 
That will be so (in all dimensions for a given distribution) if the possible values of \Jxy\ 
can be arbitrarily large or arbitrarily small (or both). This includes Gaussian spin glasses 
and disordered ferromagnets (or spin glasses) with a uniform distribution on (0, J) (or on 
(—J, J)); it does not include disordered ferromagnets with a distribution on (J — e, J). 

Theorem 3. The energy densities Em{Ri, • • • , Rai) and Em+i{Ri, • • • , Rm+i) satisfy 
Em > Em+1 providing that Rm+i is sufficiently small for given Ri, . . . , Rm (and the as- 
sumption mentioned above on the coupling distribution is satisfied). Moreover Em for any 
finite M is larger than the ground state energy density, which (for any i?i,i?2, • • • ) is the 
limit of Em as M — > 00. 

Proof. By Theorem 2, for the given Ri, . . . ,Rm, almost every o"^ will have the same 
energy density Em- For a given large t', we can choose Rm+i small enough so that the 
energy density EM+iit') is as close as we want to EMit'); this is because -Ra^+i is so small 
that only a very tiny density of rigid M -|- 1-clusters have been flipped by time t' (in the Pm+i 
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dynamics) so that cr^^ and (J^m+i ^^^Y close. Furthermore if t' is large enough, can 
be made as close as we want to the limiting value Em- So for any small 6, we can choose 
first f and then Rm+i so that (a) \EM+iit') — Em\ < S and (b) at most a density 6 of rigid 
M + 1-clusters have been flipped by time t' (in the Pm+i dynamics). 

The rest of the proof is to show that as time increases from t' to oo in the Pm+i dynamics, 
enough other rigid M + 1-clusters will flip to lower the energy density from EM{t') by more 
than 6. To do this, it suffices to show that for almost every pair J', 0"°, there exists a density 
p of local configurations (of J^, a^) for which one has M-spin-fiip stability but for which a 
fiip of some rigid M + 1-cluster will lower the energy by at least e. Then the desired result 
follows by picking S small enough (depending on p and e). 

Here is one way to find such local configurations. First, suppose J' is such that there is a 
linear chain of 2M + 1 couplings all of whose magnitudes, except for the coupling at the very 
center of the chain, are very close to some "large" value Ji. Suppose further that the center 
coupling magnitude is close to an "intermediate" value J2 and all other coupling magnitudes 
within distance (approximately) M of the linear chain have magnitudes close to a "small" 
value J3. What is crucial is not the absolute sizes of the Jj's but that Ji ^ J2 ^ J3. 
Next suppose a" is such that at time zero the 2M "large" couplings are all satisfied but 
the "intermediate" center coupling is unsatisfied. Such a local configuration (which will 
occur with strictly positive density because of our assumptions on the coupling distribution) 
will have the desired stability properties with e approximately equal to J2. Here the rigid 
M + 1-cluster to be fiipped is half of the linear chain on either side of the center coupling. 

To prove the final statement, we let a be some ground state and a' be some M-spin 
fiip stable state (with M large). We consider Z'^ as the union of disjoint cubes that are 
translates of A^+i with L chosen so that the volume of each cube is below M; each cube 
should be thought of as an interior (a translate of A^) plus boundary. By the metastability, 
the restriction of a' to any interior is a finite-volume ground state for its own boundary 
condition. Hence if we construct a a" to agree with a on all the interiors and with a' on all 
the boundaries, the energy density E" of a" must be higher than E' of a' (because we no 
longer have ground states in the interiors for the boundary conditions). On the other hand, 
clearly E" - E is of order L'^-^/L'^. Thus E' < E + 0{L-^) and hence limM^oo < E. 
All ground states have the same energy density E (as can be shown by a similar argument) 
and it readily follows that the energy density of any spin configuration is at least E] thus 
Em > E and hence Em ^ E as M ^ 00, completing the proof, o 

6 Remanent magnetization 

Suppose that a spin glass with Hamiltonian (^ is prepared in the uniform initial state 
(Ta; = +1 for all X G Z'^, and evolves at zero temperature through the usual 1-spin-fiip Glauber 
dynamics. What is the typical magnetization of the metastable state into which the system 
evolves? This quantity is of interest because it is related to experimental measurements of 
the thermoremanent magnetization in laboratory spin glasses ^. For the continuously 
disordered spin chain in one dimension this quantity was found to be 1/3 [^, Following 
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the practice in those papers we will simply refer to it as the remanent magnetization and 
denote it mrem- 

The question can be recast more generally as finding the value of the "remanent overlap" 
between the initial and final states, g^em = liniL^oo |Al|~^ X^xgAi, '^S'^x^- Because of the 
translation- invariance of this quantity, it will be constant for almost every JT", cr° and cji; 
thus no further averaging (beyond the spatial) is needed. By a simple gauge transformation 
argument (see the end of the proof of the next theorem), for a symmetric spin glass (i.e., 
where the couplings are symmetrically distributed about zero), q^em = "^rem- Put another 
way, the question as to the value of the remanent overlap is how much direct memory of the 
initial state does the final state retain? This version of the question is as relevant for random 
ferromagnets as for spin glasses, and so we will hereafter address the problem in both its 
forms: i.e., as the remanent overlap of a continually disordered system dynamically evolving 
at zero temperature from a random initial state, and also as the remanent magnetization of 
a symmetric spin glass evolving from a uniform initial state. 

The result of Theorem 2 applies also, as already noted, to the magnetization per spin, 
which is zero for almost every M-spin-flip stable state. However, when the initial state is 
chosen in a special way (i.e., all plus), we expect to "land" in a 1-spin-fiip stable state with 
positive magnetization (cf. the discussion following Theorem 2). The next theorem provides 
a general result for highly disordered models (Sec. ^ in any dimension. We will see that the 
result mrem = 1/3 in the ordinary ID spin glass immediately follows as a special case. 

Theorem 4- Consider the highly disordered model in d dimensions described in Sec. p. 2. 2 , 
undergoing single-spin-fiip dynamics at zero temperature from a random initial state a^. For 
almost every coupling realization, and Ui, the resulting will have a remanent overlap 
with cr° equal to d/{4:d — 1). Similarly (and consequently), for a highly disordered symmetric 
spin glass, if the inital state is uniform with ax = +1 for all x G Z"^, then the resulting 
will have a remanent magnetization equal to d/{4d — 1). 

Proof. From the definition of the highly disordered model on Z'^, it follows that any 
coupling Jxo,yo that is larger in magnitude than any of its 2{2d — 1) neighboring couplings 
will automatically satisfy the following condition: 

\Jxo,yo\ > T^^^i X! l-^i^o.^l; X! i^) 
2:|[a;o— z||=l z':||j/o— z'||=l 

Therefore, if such a bond is satisfied in a", it remains satisfied for all time. We will refer to 
these as "strong" bonds. We will see that these bonds determine the remanent magnetization, 
so we first need to compute their density in almost every coupling realization. 

The probability of any given bond having this "strongness" property is identical to 
that of an arbitrary element (call it Xi) in a set of 4d — 1 independent random variables 
(Xi, X2, . . . , X^d-i), chosen from a common continuous distribution, having the highest value 
in the set. (The Xj's here represent the magnitudes of a given coupling and its 4d — 2 neigh- 
boring couplings.) Since each X^ is equally likely to be the highest value, it follows that the 
probability of an arbitrary coupling being strong is l/{4d — 1). Then, if Ug is the density of 



19 



spins that are located on either end of strong bonds, 



= [l/(4rf- 1)] X 2 X c/ = 2rf/(4(i- 1), (8) 

where the factor of 2 arises because each strong bond connects to 2 spins, and the factor of 
d is the ratio on the lattice Z'^ of the number of bonds to the number of spins. 

To find the remanent overlap, we first note that, due to the randomness of ct°, exactly 
one half of the strong bonds are satisfied at time zero and will contribute to grem, and the 
other (unsatisfied) half will not contribute (because in every such bond will be satisfied). 



What about spins connected to other bonds? It was shown in |60] that the influence clusters 
of the strong bonds in the highly disordered model have a tree-like structure, i.e., contain 
no loops (this structure on a larger scale, arising for similar though not identical reasons, 
also defines the static ground-state properties of these models; see |63|). Because of the 
tree-like influence structure, the cr^'s for these other x's are completely independent of the 
corresponding a^'s and it follows that they also contribute zero to the remanent overlap. 
Therefore, 

qrem = ^[2rf/(4rf " 1)] + = d/{4d - l) . (9) 

The last claim of the theorem follows now by a standard gauge transformation argument, 
which converts a random cr° into a uniform all plus state, at the expense of doing a cor- 
responding transformation to the couplings. But for a symmetric spin glass, the resulting 
coupling configurations are identically distributed with the original ones, which completes 
the proof, o 

Remark. In one dimension, Eq. (^ reduces to m^em = 1/3, a result found in |Q (see also 
4^). This is not a coincidence, because the two ingredients used in the proof of Theorem 3 — 



the property that a coupling whose magnitude is greater than those of any of its neighbors 
satisfies Eq. (|^), and the additional property that all influence clusters contain no loops, 
occur automatically in any ID model with a continuous coupling distribution. (In that 
sense, continuously distributed ID models are already "highly disordered.") 

What about realistic models in dimensions higher than one? We present now a heuristic 
derivation of a lower bound for mrem(c^), based again on the density of strong bonds. The 
condition for a strong bond is given by Eq. (0), which involves two independent sums of 
2d — 1 random variables, Xi, . . . ,X2d-i and X[, . . . ,X2^_3^, corresponding to the absolute 
values of the couplings at either end of the strong bond. Using the independence of the sums 
on either side of the bond, we find the following formula for Probrf(Js), the probability of any 
given bond being strong, where denotes the probability density function for Xi + . . . + 
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^'^"'Hi) ^2<i-i(?/)^l/| d^- (10) 



Probrf(J,) 

Following the same procedure as in Eq. (P) yields a formula analogous to Eq. @, 

rrirem > dPTohd{Js) ■ (11) 
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However, this expression assumes that the contribution of the spins on all other bonds is 
positive or zero. Although this is plausible, we do not have a rigorous argument for it, and 
so the result in Eq. (0) should be considered heuristic. 

The large d behavior of ( p!0D and (|ll]) depends on the nature of the common distribu- 
tion of the individual couplings. For example, if it is a uniform distribution on [—J, J] 
(so that = 1/J on [0,J] and zero elsewhere), one finds that Prob(i(Js) behaves as 

exp(— 4(ilog((i) ± 0{d)) as d ^ oo, while for a Gaussian distribution, the 4 in the exponent 
is replaced by 2. We spare the reader the details of these calculations and estimates, but 
note that if on the other hand, the magnitude of the couplings could neither take on very 
small nor very large values (e.g., if the J^y's were uniformly distributed on [—J, — e] U [e, J]), 
then Probd(Js) would be identically zero above some dimension. 



6.1 Nature vs. nurture 

A problem related to remanence is to ask for the extent to which the final state is determined 
by the initial spin configuration. This should be distinguished from asking for the fraction 
of spins that have the same final value as their initial value; rather, we are asking here what 
percentage of is determined by cr°, where the remainder will depend on the dynamics 
realization. 



In order to quantify this, we introduce a quantity previously considered in This 
quantity, denoted g/j, is a kind of dynamical order parameter somewhat analogous to the 
Edwards- Anderson order parameter qEA- Let (■) denote the average with respect to the 
distribution Pi over dynamical realizations c^i, for fixed J and . We will here use an 
overbar to denote the remaining averages over J and a"; i.e., with respect to the joint 
distribution Pj^a» = Pj x -Po-o- We then define qo = limi^oo 9* (providing the limit exists, 
which it does in the ordinary spin glass and random ferromagnet), where 

= hm (1/|A^|) E(^x)' = (^- (12) 

(The equivalence of the two formulas for g* follows from translation-ergodicity.) When a°° 
exists, then is also given by the same expressions as in (|12D but with cr* replaced by a^. 
As already noted, the order parameter q£, measures the extent to which a°° is determined 
by cr° rather than by Ui (for fixed J'). This is because the middle expression of ([T^) is the 
overlap between a* and a'* corresponding to independent replicas ui and u[ but the same 
0"° (see also Theorem 6 below). Of course, g° = 1 because is completely determined by 
0"°, while a value g_D = would mean that for every x, yields no information about a^. 



We now present an exact result in one dimension earlier proved in |]55|. 

Theorem (Nanda- Newman- Stein) /|53|/. In the one-dimensional disordered model with 
continuous coupling distribution, = 1/2. 

Because the technical proof appears in [Q, we present here only an informal version. The 
idea is that, as discussed earlier, the one- dimensional chain breaks up into disjoint dynamical 
"influence clusters", bounded on either end by "weak" couplings satisfying Eq. (BT). Each of 
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these clusters is governed dynamically by a single "strong" bond, by which we mean that 
once the spin configuration is such that the strong coupling is satisfied, the state of the spins 
of a°° within the rest of its infiuence cluster is completely determined (by the signs of the 
couplings). Put more picturesquely, there is a "cascade of infiuence" emanating from the 
strong bond and trickling down to either side of its infiuence cluster until all couplings within 
are satisfied. This means that a spin value at t = oo is already determined by {J and) 
if the strong bond in its infiuence cluster is satisfied at t = 0, and is completely determined 
by uji otherwise. Because this satisfaction probability is 1/2, the result follows. 

It is not difficult to extend this result to the highly disordered model in any dimension 



55 1 where, because all infiuence clusters have a tree- like structure, the idea behind the proof 



is essentially the same. 

For the ordinary spin glass or random ferromagnet, we cannot compute qd precisely, but 
it is easy to show that strict inequalities hold at either end; that is, < < 1, so the final 
state is not completely determined either by the initial state {qr, = 1) or by the dynamics 
{qd = 0). We refer the reader to (see the proof of Theorem 4 of that paper) for the 
argument. 



7 Basins of Attraction 

The basin of attraction of a metastable state may be defined as the set of starting 
configurations 0"° such that (T^((T°, wa/) = for almost every um- (This generalizes to M- 
spin-fiip dynamics the definition given in A similar definition for the basin of attraction 



of a pure state at positive temperature was given in ||5T]]; see also related discussions in 
||71||.) Properties of basins of attraction of metastable states have played important roles in 
studies not only of disordered system dynamics, but also those of neural nets, combinatorial 
optimization, and related types of problems where many locally optimal solutions exist. Here 
we ask: how large (in the sense of the infinite-temperature (uniform) distribution on spin 
configurations) is the union of all the domains of attraction of all the metastable states? 

Theorem 5. Under the same assumptions on the coupling distribution as in Theorem 3, 
almost every initial configuration cr° is on a boundary between (two or more) metastable 
states. Thus, the union of the domains of attraction of all of the metastable states forms a 
set of measure zero (in the space of all (T°'s). 

Proof. For M = 1 (and without the extra assumptions of Theorem 3), the result follows 
from the fact stated in Sec. ^ and proved in that < 1 strictly for disordered models 



with continuous coupling distributions in any dimension. That is, for almost every and 
(T°, the final state must depend on the dynamical realization um] the outcome is not 
determined purely by cr°. 

To show for M > 1 that the outcome is not determined purely by a", we consider the 
same type of linear chains of 2(M — 1) + 1 couplings as in the proof of Theorem 3 — again 
with all couplings other than the center one satisfied at time zero. Then the final state of 
the spins along that chain is determined by ujm, i-e., by which of the two halves of the chain 



22 



flips first so that the chain becomes M-spin-flip stable. 



Remark. Similar results for pure states were proven in [51 1 — i.e., that, if many pure 



states exist in the ordinary spin glass in some dimension d and temperature T, then the union 
of their basins of attraction form a set of measure zero in the space of all spin configurations 
(uniformly distributed in the usual sense). That a similar result holds for metastable states is 
not necessarily surprising, but we believe that more is true: namely that almost no metastable 
state lives in the basin of attraction of a single pure or ground state. This (which we shall 
pursue elsewhere) would seem to contradict a standard view in the literature. 



8 Dynamical evolution from a single initial state 

We now revisit the questions discussed in Sec. ^from a different standpoint. In that section 
we discussed the nature and distribution of overlaps for pairs of metastable states (indepen- 
dently) chosen from the entire set {cr^} of M-spin-flip stable states, generated through our 
dynamical procedures. Here we consider a restricted subset of the 1-spin-flip stable states, 
which, although still uncountably infinite, is a set of zero measure of the 1-spin-flip stable 
states {crf^}. This is the set of states dynamically generated from a single a" (chosen from the 
usual infinite temperature distribution). Information on states chosen from this restricted 



set may be relevant to studies of damage spreading |73|, |74[ , which in some formulations 
examines overlaps of pairs of states dynamically generated from the same initial state. 

Theorem 6. For fixed JT", consider two metastable states a'^{a^,uji) and crf^(cr°, cu^). To 
simplify the notation we will in this section refer to these states as ct°° and (t'°°, respectively. 
In all cases uJi and uj[ are chosen independently. Then for almost every such pair, the spin 
overlap equals > 0, where is the dynamical order parameter defined as the t ^ co 
limit of g* in Eq. (|12]). 

Proof. Throughout this proof we suppress the dependence of the two final states on cr°, 
because both metastable states are understood to evolve from the same initial state; we also 
suppress the M = 1 subscript on . Then the overlap of the two final states is 
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lim |A^|-i = Ej,.o,^,,^, (^i)^r K)] , (13) 



where Ej denotes an average with respect to the distribution over the couplings, and sim- 
ilarly for the other distributions. Eq. (|1^) follows from the translation-ergodicity of the 
distributions from which the couplings, initial state, and dynamical realizations are chosen, 
along with the translation-invariance of the overlap. Because the dynamical realizations uji 
and Lu'i are chosen independently, it follows that 

^j,.o,.„.; [a^{u;,)a^{u;[)] = Ej^^o [E^, {a^{uJ^))f = Qd . o (14) 
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9 Finite volumes 



Most of the preceding discussion concerns infinite-volume disordered systems. Because ex- 
periments and numerical simulations are done on finite systems (and in the latter case often 
not very large ones), it is important to study how the theory of metastable states constructed 
so far is modified when attention is restricted to finite volumes. It has often been the case 
for conventional homogeneous systems that both thermodynamic and dynamical behavior 
in infinite systems is a straightforward extrapolation from behavior in large finite volumes; 
but recent work has shown that for disordered systems such simple extrapolations can often 
fail, and in general the relationship between the physics of finite and infinite systems can be 



subtle [p^ WE, 



We therefore re-examine many of the questions previously raised and answered for infinite 
systems in the context of a finite system on a cube of volume V = L'^ spins. The first 
question we will address is how the number of metastable states scales with volume. We 
showed in Theorem 1 that for infinite systems the number of M-spin-fiip metastable states 
is uncountably infinite in any dimension; it is natural then to expect that this number scales 
exponentially with volume (in a d-dependent fashion) for finite systems, and we will now 
prove that this this is true in general. In some models, like the ordinary ID disordered chain, 
or the highly disordered model in general dimensions, the scaling behavior of the number of 
1-spin-flip stable states can be calculated exactly. 

Theorem 7. Let NM,d{V) denote the number of M-spin-fiip stable states in the cube 
of volume V = L'^ ind dimensions. Under the same assumptions on the coupling distribution 
as in Theorem 3: for the ordinary spin glass and random ferromagnet NM,d{V) = exp [0(K) 
in the sense that NM,diV) is bounded above by exp a'l^{d)V and below by exp a^,j{d)V 
where the coefficients a^j{d) > and a'lj{d) < oo depend on the model chosen. In bot 
the highly disordered spin glass and highly disordered random ferromagnet, for M = 1, 
V-^\n[Ni^diV)] converges to ai{d) = {d\n2)/{Ad - 1) as ^ oo. 

Remark. As already mentioned, results for the highly disordered model apply also to the 
ordinary ID disordered chain, where the coefficient becomes ai(l) = (ln2)/3, in agreement 



with earlier calculations HQ, 42 



Proof. We will prove the second claim first. Computation of the exact number of 1-spin- 
fiip stable states in the highly disordered model consists of two parts: computing the density 
of strong bonds (satisfying Eq. (|^)), and showing that the number of 1-spin-fiip stable states 
corresponds to the number of ways to satisfy all the strong bonds. 

The density of strong bonds in the highly disordered model was already computed in the 
proof of Theorem 4, in the discussion preceding Eq. (^). From that discussion, the average 
number of strong bonds nh{d, V) in volume V satisfies 

V-^Tibid, V) [d/{Ad - 1)] . (15) 

Each strong bond (which must be satisfied in all M-spin-fiip stable states, for any M) can 
be satisfied in two ways, corresponding to a simultaneous flip of the two spins at either end 
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of the bond. To complete this part of the argument, we need to show that the number of 
1-spin-flip stable states equals 2"'''^'^'^^ 

To do this, we note that the 1-spin-flip dynamics breaks Z'^ up into disjoint influence 
clusters, as shown in [^, These have a tree-like structure, so that under 1-spin-flip 
dynamics each has two possible spin configurations, related by a global spin flip; the spin 
configuration of each influence cluster is determined entirely by that on the strong bond. 

To prove the first claim of Theorem 7, we will establish lower and upper bounds for 
^M.d^y) in the ordinary spin glass or disordered ferromagnet. A trivial upper bound is 
obtained by noting that the number of metastable states cannot exceed the total number of 
spin configurations, so that for any M, a|^((i) < In 2. To establish an M-dependent lower 
bound, we consider first the case M = 1. The density of strong bonds (obeying Eq. (^) was 
computed in Eq. (0), but it is sufficient for our purposes here to note simply that under 
the assumptions of Theorem 3 on the coupling distribution, this density is positive is any 
dimension. 

Even though influence percolation may occur in these models, the strong bonds are still 
satisfied or unsatisfied independently of one another (and once satisfied, remain so for all 
time), as in the highly disordered case. Thus there are (approximately) 2''^™*^^'^=)]^ ways for 
the strong bonds to be satisfied and at least an equal number of 1-spin-flip stable states. 

The proof is completed by noting that for M > 1, we may consider the same type of linear 
chains of 2(M — 1) -|- 1 couplings as in the proof of Theorem 3. Here the center couplings 
of the chains play the role of the strong bonds and the density of center couplings replaces 
Prob(Js) in obtaining a lower bound for aj.j{d). This completes the proof, o 

We now turn to the important question of whether the results obtained so far for infinite 
systems — in particular, the answers 4) - 6) discussed in Sec. 1.2.2 — hold (to an increasingly 
good approximation as system size increases) in large finite volumes. The answer to 2), 
showing convergence of the dynamics (within a volume and with specified boundary 



conditions) to a limiting cr^^ was already provided in Sec. |3]T 



Why is it important to study this? The reason is that it is not necessarily the case a priori 
that the answers to 4) - 6) would hold, even roughly and in a qualitative sense, for large 
finite volumes in the limit as L — > oo. It could conceivably be the case, for example, that 
the overlaps between final states evolved from two arbitrarily chosen initial states, and with 
independent dynamics, might not be concentrated about zero in finite volumes of arbitrarily 
large size (even though the overlap would be exactly zero for the infinite volume system 
according to Theorem 1 of Sec. H); instead, it might be, if one looked at many pairs of initial 
states and dynamical realizations, that one would find a distribution of final state overlaps 
spread over many values, which would not increasingly concentrate about zero as L ^ cxd. 
This would be a type of dynamical analogue to the "nonstandard SK picture" , or a similar 
thermodynamic scenario, raised as a logical possibility in |75| (but ruled out as a viable 
option through a combination of rigorous and heuristic arguments in [0). 

We will now show that such scenarios should not in fact occur; that is, the answers 
to 4) - 6) will hold to a good approximation in large finite volumes, and with increasing 
accuracy as their size increases. So, to use the example in the preceding paragraph, we would 



25 



find that the distribution of overlaps between final states evolved from pairs of arbitrarily 
chosen initial states, and with independent dynamics, would be clustered about zero in an 
increasingly tight distribution as L — > oo. We will prove this rigorously for both highly and 
strongly disordered models (the latter of which has similar thermodynamic behavior to an 
ordinary spin glass or random ferromagnet), and will provide convincing heuristic evidence 
that the same remains true for ordinary disordered models. Our strategy will be to show 
that the final state cr^-j agrees with the infinite-volume cr°° (in a way to be made precise 
momentarily) increasingly well as L — > oo. (As always, our results are for almost every state; 
in the finite- volume context, this means the exclusion of an increasingly small probability 
event, typically exponentially small, in the volume.) 

We now make these ideas more precise. Consider a volume A^^ with specified boundary 
conditions, such as free, fixed, or periodic. As always we take Aj^ to be a d-dimensional cube 
of side L centered at the origin. Consider within that cube a smaller one, denoted A^,', also 
centered at the origin, and with L' « L. The boundary conditions on K^i may be the same 
as those on or different. Consider now the two states a*^-) and cr\Li)i generated from a pair 
of initial states and a pair of dynamical realizations that, in each case, are identical within 
the smaller volume Kll We define the "region of agreement" (at time t) between cx^^^ and 
cr*^,-) as the set of sites x within A^/ where (^li)^ = ^\l')x- 

We want to ask whether (for most initial states and dynamical realizations) the fraction 
of sites in A^,' belonging to the region of agreement at time t = oo is close to one. More 
precisely, we want to know whether if we take first the limit L ^ oo and then t — > oo, the 
agreement fraction approaches one as L' oo. If so, then we would be finished. 

Let us examine this in more detail. Consider, for example, periodic boundary conditions 
on both Ai and A/,/. Because a limiting final state exists in each volume, the probability 
that the spin ax at any particular site x has not reached its final state, i.e., will flip again, 
after a time Tj,, must go to zero as increases for flxed L' and L. If this probability goes 
to zero independently of L' and L as both become large (i.e., if the probability gviTx) in 
A^/ is bounded by an L'-independent function g{Tx) that goes to zero), then we're done. 
Put another way, eventually (as system sizes increase) the effects of the receding boundaries 
(even as t — >■ cxo) are felt increasingly less. 

To see why this proves the result, we can use this probability to choose a time r where, 
say, 95% of the sites in Kli have reached their flnal conflguration, and this time is independent 
of L' . Now compare this to the restriction to A^/ of the corresponding inflnite- volume . 
After the time r, the only spins within A^^ that "notice" they're subject to periodic boundary 
conditions would be those within some distance of order one (as L' — > oo) of the boundary. 
The others reach the same state as in the inflnite system, and so the overlaps agree in that 
region. 

This argument clearly will hold when M = 1 in any model where influence percolation 
does not occur, such as highly or strongly disordered models. In those systems, all dynamics 
is localized, as discussed in Sec. |3.2.2| . Therefore, as L — »• oo, there will be some L beyond 
which every spin in V will reach the same state as in the inflnite system; that is, every 
influence cluster will be unable to distinguish (dynamically) whether it belongs to a flnite or 
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infinite system. Although the argument was presented in an informal way, this is sufficient 
to prove the result, stated formally as Theorem 8. 

Theorem 8. For single-spin-fiip dynamics in any model where influence percolation does 
not occur, such as ordinary ID disordered chains, or both the highly and strongly disordered 
models, the distributions of overlaps, energies , and other global properties of metastable 
states in large finite volumes approaches the infinite-volume results as the volumes tend to 
infinity. 

While this argument is rigorous when M = 1 for models without influence percolation, 
it does not carry over easily to M > 1 (except for ID where a modified influence percolation 
argument can be carried out) or to ordinary disordered models in dimensions greater than 
one. Heuristically, though, the same result should apply there too. In order for it not to do so, 
it would have to be the case that the final energy density in finite volumes, for some specified 
boundary conditions, would be lower (by an amount not tending to zero with volume) than 
that in the infinite system. But the absence of boundary conditions in the infinite system 
means that, in any finite subvolume, the spin configuration can dynamically adjust to the 
fixed coupling realization at the boundaries in order to attain the lowest possible energy; it 
is difficult to see why the energy should be lower when this option is not available due to the 
boundary condition being rigidly imposed externally, and without regard to the couplings. 

But even if this were so, it would still be irrelevant to the state observed on any numer- 
ically or experimentally accessible timescale. This is because, in the infinite volume case, 
the system relaxes to a final state within a finite subvolume in some finite time. This same 
time would set the scale for an initial relaxation of a large finite-volume system. There must 
then be an additional timescale, depending on L, for information generated at the boundary 
to propagate to spins deep in the interior, changing their state. This new timescale must 
diverge as L — oo because of the finite signal propagation time imposed by the dynamics 
(Sec. that is, for large enough volumes the region of agreement of the final states gener- 
ated by finite- volume and infinite- volume dynamics would be most of A/,, up to timescales 
diverging with L. 

The scenario described in the last paragraph is unlikely, however, because it is already 
unlikely that finite- volume energy densities are lower than those for infinite-volume systems. 
It is noted only to show that, for any practical scenario of experimental interest, the results 
of Theorem 8 should hold also for M > 1 and for ordinary disordered systems in any finite 
dimension. 

10 Ground states 

All of our preceding discussion has concerned metastable states, stable up to M-spin flips. 
These are generated by a dynamics with distribution Pm, in which lattice animals up to 
size M are rigidly flipped as described in Sec. It is natural to ask what happens if 
we let M — > cxd; in particular, can a dynamics that allows rigid flips of lattice animals of 
unbounded size be constructed so as to generate inflnite-volume ground states? We will 
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address that question in this section and see that the answer (when formulated carefully) is 
yes. However, unlike the case for finite M, we cannot show convergence to a final state (and 
indeed, convergence may not be valid, as we discuss below), and so cannot obtain results of 
the kind generated for metastable states. We will also discuss several issues related to the 
connection between ground states and M-spin-fiip stable states, in both finite and infinite 
volumes. 

We therefore consider the "lattice animal dynamics" introduced in Sec. ^, now with the 
lattice animal size unbounded. The rates Rk were already chosen so that the dynamics, as 
specified by clock rates (or equivalently, mean waiting times for a given lattice animal to 
attempt to flip), ensures that information doesn't propagate infinitely far in a finite time 
and so there is a well-defined dynamics (see Sec. |[). The assumptions on the -R^'s imply the 
following lemma, which will be needed to prove the next theorem. 

Lemma. Consider a volume A/, and a given lattice animal A that is entirely inside (i.e., 
no spins in A touch the boundary OAl). Then at an arbitrarily chosen time t, the probability 
Pi that the clock of A "rings" (i.e., it attempts to flip) before time t + 1 and before the clock 
of any other lattice animal touching A^ or OAl, is strictly positive (independently of t or 
the spin configuration at time t). 

Proof. This follows immediately from the nature of the dynamics (whose distribution is 
denoted hereafter by Pqo) because of our assumptions on the rates Rk needed to make the 
process well-defined. In particular, if we denote the number of sites in a lattice animal A by 
|y4| and denote by R^^^ the (finite) sum of R\b\ over all lattice animals B that touch A^ or 
its boundary, then 

= (i?l^l/i?(^)) (1 - e-«''V (16) 

We now show that the dynamics defined by Pqo leads to a ground state, in the sense to 
be discussed below. 

Theorem 9. Consider the dynamics with distribution Poo, and a finite Al oi arbitrary 
size. Then after a random time ti (depending on L, J , cr°, and dynamics realization cUoo), 
the spin configuration inside A^ forever remains in a ground state subject to its boundary 
conditions (where the ground state and the boundary condition could themselves change 
with time). 

Proof. We note first that, as always, (with probability one) any fixed lattice animal can 
undergo only finitely many energy-lowering flips. This then implies that the following event 
must have zero probability: there exists an infinite sequence of times ti, • • • ^ oo such that 
at each of those times, the spin configuration inside the cube (given its boundary conditions 
at that time) is not in a ground state configuration. This is because, after any of those times, 
the above Lemma implies that there is a positive probability in the next unit of time that 
some lattice animal strictly inside the cube flips to lower the energy. The finiteness of L 
implies a finite number of lattice animals inside A/^, so that if this event did not have zero 
probability, then, with positive probability, some lattice animal inside the volume would flip 
infinitely many times, o 
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We emphasize a few points, most importantly, that there is no claim that the dynamics 
converges to a specific ground state (though it might, depending on dimension and 
disorder distribution). The proof of convergence for finite M (||5^ and Sec. p.2| above) fails 
here because now the energy per spin of a lattice animal fiip of size M can go to zero as 
M —>■ oo. Of course, if convergence to a ground state a°° can be shown for a particular model, 
it would immediately imply (cf. Theorem 1) that there would be an uncountable number of 
ground states, and their overlap distribution function would be a delta- function at the origin 
(see also discussions in ||6^, |7|]). It is therefore of interest to pursue this question, but we 
will not do so here. 

A second point is that our dynamics "algorithm" finds ground states in the sense that 
any finite region surrounding the origin will eventually always be in some ground state (no 
energy-lowering fiips possible within the region) after some time (depending on the various 
realizations as discussed in Theorem 9). It could still happen, though, that spins within the 
region fiip infinitely often (as they must if there are not uncountably many ground states, 
as is expected, e.g., in the 2D random ferromagnet). These could occur either through a 
rigid fiip of the entire region, or through changes in boundary conditions due to fiips of large 
lattice animals intersecting the region. 

Finally, we note that this is a rare example of a dynamical process that can be proved to 
lead to a Gibbs state (in this case, a ground state at T = 0). While it is widely expected that 
finite-temperature Glauber dynamics, and similar dynamics that satisfy detailed balance, 
lead to Gibbs states at positive temperature, as t — > oo, we are unaware of any general proof 



(for a discussion of related T > results, see Sec. IV.5 of |l59[| ). 

It may seem surprising that there can be an uncountable number of states energetically 
stable to rigid fiips of M spins, where M can be arbitrarily large (but fixed), and yet there 
exists only a single pair of ground states. Yet this is precisely what happens in disordered ID 
chains, and almost certainly as well in the 2D disordered ferromagnet. (Recent numerical 
evidence also points towards only a single pair of ground states in the 2D spin glass as well 
|78| , [79[].) Caution should therefore be exercised whenever information on ground (or pure) 
states is used to extract information on metastable states, or vice-versa. 



11 Conclusions 



We began in Sec. |1.2.1| with a list of ten questions about basic properties of metastable states 



in disordered systems, providing brief answers in Sec. |1.2.2| followed by a detailed study in 



subsequent sections. These questions and answers aimed towards understanding fundamental 
features of the set of M-spin-fiip stable states in spin glasses and disordered ferromagnets, 
such as their numbers, basins of attraction, energies, overlaps, remanent magnetizations, and 
relations to thermodynamic states. 

From a broader perspective, we have presented a viewpoint for considering metastable 
states in spin glasses and random ferromagnets; its essence is that one can construct a 
systematic approach towards their study, just as has been traditionally done for fundamental 
statistical mechanical objects such as spin configurations or thermodynamic states. We 
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approach the problem of metastabihty as in those cases, by noting that one is often most 
interested (with exceptions as discussed) in the typical states that appear in a physically 
relevant ensemble for the particular problem under study. In the case of spin configurations, 
this enemble is usually the Gibbs state at a given temperature; in the case of thermodynamic 
states, we have proposed in previous papers |6^, |75|, that the appropriate ensemble is the 



metastate. In the current context of metastable states, we propose a natural ensemble (on the 
{cr°°(cr°, a;j\/)}'s) that arises from zero-temperature "lattice animal" dynamics evolving from 
a spin configuration generated through a deep quench; we call this M-dependent measure 
the M-stable ensemble. 

To summarize, we propose the following comparison: 

Object Ensemble 

Spin configuration =^ Gibbs ensemble 

Gibbs state =^ Metastate ensemble 

Metastable configuration =^ M-stable ensemble 

We suggest that this dynamical approach provides both a natural ensemble and the 
corresponding tools for studying metastable states. 



References 

[1] Recent Progress in Random Magnets, D.H. Ryan, ed. (World Scientific, Singapore, 1992). 
[2] K.H. Fischer and J. A. Hertz, Spin Glasses, (Cambridge University Press, Cambridge, 1991). 
[3] K. Binder and A.P. Young, Rev. Mod. Phys. 58, 801 (1986). 

[4] P. Refrigier, E. Vincent, J. Hamman, and M. Ocio, J. Phys. (Paris) 48, 1533 (1987). 
[5] P. Sibani and K.-H. Hoffmann, Phys. Rev. Lett. 63, 2853 (1989). 
[6] K.-H. Hoffmann and P. Sibani, Z. Phys. B 80, 429 (1990). 

[7] M. Lederman, R. Orbach, J.M. Hamann, M. Ocio, and E. Vincent, Phys. Rev. B 44, 7403 

(1991) . 

[8] P. Svedlinh, K. Gunnarson, J.-O. Andersson, H.A. Katori, and A. Ito, Phys. Rev. B 46, 13687 

(1992) . 

[9] E. Vincent, J. Hamann, and M. Ocio, in D.H. Ryan, op. cit., pp. 207 - 236. 
[10] J.P. Bouchaud, J. Phys. I 2, 1705 (1992). 

[11] F. Lefloch, J. Hamann, M. Ocio, and E. Vincent, Europhysics Lett. 18, 647 (1992). 

[12] H. Rieger, J. Phys. A 26, L615 (1993). 

[13] S. Franz and M. Mezard, Physica A 210, 48 (1994). 



30 



[14] E. Vincent, J.P. Bouchaud, D.S. Dean, and J. Hamann, Phys. Rev. B 52, 1050 (1995). 

[15] Y.G. Joh, R. Orbach, and J.M. Hamann, Phys. Rev. Lett. 77, 4648 (1996). 

[16] Y.G. Joh, R. Orbach, and J.M. Hamann, Phil. Mag. B 77, 231 (1998). 

[17] R.G. Palmer, Adv. Phys. 31, 669 (1982). 

[18] M.D. Ediger, C.A. Angell, and S.R. Nagel, J. Phys. Chem. 100, 13200 (1996). 

[19] For recent papers that study metastability as a unifying theme in glasses, spin glasses, neural 
network models, and other disordered systems, see G. Parisi, in 25 Years of Non-Equilibrium 
Statistical Mechanics, in JJ. Brey, J. Marro, J.M Rubi, and M. San Miguel, eds. (Springer- 
Verlag, Berlin, 1995), pp. 135 - 142; K. Binder, ibid., pp. 143 - 160; and D. Sherrington and 
A.C.C. Coolen, ibid., pp. 161 - 176. 

[20] J.J. Hopfield, Proc. Nat. Acad. Sci. USA 79, 2554 (1982). 

[21] D.J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. Lett. 55, 1539 (1982). 
[22] D.J. Amit, H. Gutfreund, and H. Sompolinsky, Phys. Rev. A 32, 1007 (1982). 
[23] C. Dasgupta, S.-K. Ma, and C.-K. Hu, Phys. Rev. B 20, 3837 (1979). 

[24] See, for example, K. Binder and W. Kinzel, in J.L. van Hemmen and I. Morgenstern, eds. Hei- 
delberg Colloquium on Spin Glasses (Springer- Verlag, Berlin, 1983), pp. 279 - 304; I. Mor- 
gensetern, in J.L. van Hemmen and I. Morgenstern, ibid., pp. 305 - 327; and A. P. Young, in 
J.L. van Hemmen and I. Morgenstern, ibid., pp. 328 - 345. 

[25] V. Cerhy, J. Optim. Theory Appl. 45, 41 (1985). 

[26] S. Kirkpatrick, CD. Gelatt, and M.P. Vecchi, Science 220, 671 (1983). 

[27] M.B. Weissman, Rev. Mod. Phys. 65, 829 (1993). 

[28] F. Tanaka and S.F. Edwards, J. Phys. F 10, L2769 (1980). 

[29] A.J. Bray and M.A. Moore, J. Phys. C 13, L469 (1980). By studying the number of solutions 
to the TAP equations |^^, the authors were also able to draw some conclusions about numbers 
of metastable states for < T < Tc. 

[30] C. De Dominicis, M. Gabay, T. Garel, and H. Orland, J. Phys. (Paris) 41, 923 (1980). This 
paper also contains some results on numbers of metastable states near Tc. 

[31] D. Sherrington and S. Kirkpatrick, Phys. Rev. Lett. 35, 1792 (1975). 

[32] D.J. Thouless, P.W. Anderson, and R.G. Palmer, Phil. Mag. 35, 593 (1977). 

[33] K. Nemoto, J. Phys. A 21, L287 (1988). 

[34] D. Vertechi and M.A. Virasoro, J. Phys. France 50, 2325 (1989). 
[35] L.B. loffe and D. Sherrington, Phys. Rev. B 57, 7666 (1998). 



31 



[36] V.M. de Oliveira and J.F. Fontanari, J. Phys. A 30, 8445 (1997). 
[37] S. Franz and G. Parisi, J. Phys. I 5, 1401 (1995). 
[38] E.A. Lutchinskaia and E.E. Tareyeva, Europhys. Lett. 17, 109 (1992). 
[39] S.A. Kauffman, The Origins of Order (Oxford U. Press, Oxford, 1993). 
[40] T. Li, Phys. Rev. B 24, 6579 (1981). 

[41] R. Ettalie and M.A. Moore, J. Phys. (Paris) Lett. 46, L-893 (1985). 

[42] B. Derrida and E. Gardner, J. Phys. (Paris) 47, 959 (1986). 

[43] A.J. Bray and M.A. Moore, J. Phys. C 14, 1313 (1981). 

[44] E.S. Rodrigues and P.M.C. de OUveira, J. Stat. Phys. 74, 1265 (1994). 

[45] As in previous treatments (see, however, [^] and |Q), our results are confined to energetically 
stable states. In dynamical treatments, one finds that states that are locally stable with respect 
to small free energy changes are often invoked. It is not clear how to define such objects, or 
their companions such as free energy barriers, in a clear and unambiguous way. We do not 
consider this to be a serious impediment for two reasons: first, at least at low temperatures, 
the properties of such states are likely to be closely related to the energetically stable states 
discussed here; and second, we are able to consider the properties of M-spin-flip energetically 
stable states for arbitrarily large (finite) M. We believe that it is reasonable to expect that 
these states will play an important dynamical role at positive temperature, presumably with 
larger M becoming relevant for higher temperatures. 

[46] W.L. McMillan, J. Phys. C 17, 3179 (1984). 

[47] D.S. Fisher and D.A. Huse, Phys. Rev. Lett. 56, 1601 (1986). 

[48] A.J. Bray and M.A. Moore, Phys. Rev. Lett. 58, 57 (1987). 

[49] D.S. Fisher and D.A. Huse, Phys. Rev. B 38, 386 (1988). 

[50] G.J.M. Koper and H.J. Hilhorst, J. Phys. (Paris) 49, 249 (1988). 

[51] CM. Newman and D.L. Stein, J. Stat. Phys. 94, 709 (1999). 

[52] S.F. Edwards and P.W. Anderson, J. Phys. F 5, 965 (1975). 

[53] Almost every (whether it's referring to JT", cr^, to or some function of them like the metastable 
states that are the prime subject of this paper) means a set of probability one, where the 
probability measure (i.e., ensemble) in question should be clear from the context. What is left 
out of a set of probability one is insignificant in the sense that it doesn't contribute to any 
quantitites (such as overlap distributions) defined in terms of an average over the relevant 
measure. The distinction between almost every and every is significant and forgetting it can 
easily lead to confusion and seeming contradiction. So, for example, most (but not all) of the 
results in this paper about metastable states are only valid for almost every one and these are 
precisely the ones that are relevant for deep quench dynamics. 



32 



[54] CM. Newman and D.L. Stein, Phys. Rev. Lett. 82, 3944 (1999). 

[55] S. Nanda, CM. Newman, and D.L. Stein, in On Dobrushin's Way (from Probability Theory to 
Statistical Physics), R. Minlos, S. Shlosman and Y. Suhov, eds. (Am. Math. Soc, Providence) 
(to be published). 

[56] J.F. Fernandez and R. Medina, Phys. Rev. B 19, 3561 (1979). 

[57] A. Gandolfi, CM. Newman, and D.L. Stein, "Zero- Temperature Dynamics of it J Spin Glasses 
and Related Models" , in preparation. 

[58] D. Stauffer and A. Aharony, Introduction to Percolation Theory; 2nd Edition (London: Taylor 
and Francis, 1992). 

[59] T.M. Liggett, Interacting Particle Systems (New York: Springer Verlag, 1985). 

[60] S. Nanda and CM. Newman, "Random Nearest Neighbor and Influence Graphs", Ran. Struc- 
tures and Algorithms, to appear. 

[61] CM. Newman and D.L. Stein, Phys. Rev. Lett. 72, 2286 (1994). 

[62] J.R. Banavar, M. Cieplak and A. Maritan, Phys. Rev. Lett. 72, 2320 (1994). 

[63] CM. Newman and D.L. Stein, J. Stat. Phys. 82, 1113 (1996). 

[64] D. Stauffer, J. Phys. A 27, 5029 (1994). 

[65] For recent numerical work on one such model, a 2D bond-diluted ferromagnet, see S. Jain, 
Phys. Rev. E 59, 2493R (1999). 

[66] The proof shows more than uncountability of all the M-spin-flip-stable states: the probability 
measure on the cj^'s (inherited from its dependence on and ujm and their probability 
measures) is continuous — i.e., no single spin configuration has strictly positive weight. 

[67] CM. Newman and D.L. Stein, Phys. Rev. E 55, 5194 (1997). 

[68] M. Mezard, G. Parisi, N. Sourlas, G. Toulouse, and M. Virasoro, Phys. Rev. Lett. 52, 1156 
(1984). 

[69] M.R. Evans, Phys. Rev. B 48, 3515 (1993). 

[70] For example, one might consider the following situation. Allow single-spin-flip dynamics to run 
until convergence to a speciflc af^. Using that as the starting state, raise the temperature to a 
small nonzero value T and allow positive-temperature Glauber dynamics to run for a specified 
time T, after which the temperature is reduced back to zero. It is not unreasonable to speculate 
that the Hamming distance of the final state a'f^ reached in this way from the initial uf^ 
increases with r, for r small. Such considerations may be relevant to some aging experiments 
[^, but our analysis makes clear that any possible correlations of this kind cannot be extended 
to provide information on the properties of the larger set of metastable states. This example 
illustrates that one needs to be careful to specify what is meant, for example, by correlations 
between barriers and overlaps; the meanings may be determined by the experimental situation 
under investigation. 



33 



[71] A.C.D. van Enter and J.L. van Hemmen, Phys. Rev. A 29, 355 (1984). 

[72] F. Bagnoli, J. Stat. Phys. 85, 151 (1996). 

[73] P. Grassberger, J. Stat. Phys. 79, 13 (1995). 

[74] N. Jan and T.S. Ray, J. Stat. Phys. 75, 1197 (1994). 

[75] CM. Newman and D.L. Stein, Phys. Rev. Lett. 76, 4821 (1996). 

[76] CM. Newman and D.L. Stein, Phys. Rev. E57, 1356 (1998). 

[77] The energy density results are for strongly disordered couphng distributions with finite mean. 

[78] A.A. Middleton, preprint (1999). 

[79] M. Palassini and A.P. Young, preprint (1999). 



34 



